Resource Offload Consolidation Based on Deep-Reinforcement Learning Approach in Cyber-Physical Systems

نویسندگان

چکیده

In cyber-physical systems, it is advantageous to leverage cloud with edge resources distribute the workload for processing and computing user data at point of generation. Services offered by are not flexible enough against variations in size underlying data, which leads increased latency, violation deadline higher cost. On other hand, resolving above-mentioned issues devices limited also challenging. this work, a novel reinforcement learning algorithm, Capacity-Cost Ratio-Reinforcement Learning (CCR-RL), proposed considers both resource utilization cost target systems. CCR-RL, task offloading decision made considering arrival rate, device computation power, transmission capacity. Then, deep model created allocate based on communication rate. Moreover, new algorithms regulate allocation among servers. The simulation results demonstrate that method can achieve minimal latency reduced compared state-of-the-art schemes.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Operation Scheduling of MGs Based on Deep Reinforcement Learning Algorithm

: In this paper, the operation scheduling of Microgrids (MGs), including Distributed Energy Resources (DERs) and Energy Storage Systems (ESSs), is proposed using a Deep Reinforcement Learning (DRL) based approach. Due to the dynamic characteristic of the problem, it firstly is formulated as a Markov Decision Process (MDP). Next, Deep Deterministic Policy Gradient (DDPG) algorithm is presented t...

متن کامل

Adaptive embedded control of cyber-physical systems using reinforcement learning

Embedded control parameters of cyber-physical systems (CPS), such as sampling rate, are typically invariant and designed with a worst case scenario in mind. In an over-engineered system, control parameters are assigned values that satisfy system-wide performance requirements at the expense of excessive energy and resource overheads. Dynamic and adaptive control parameters can reduce the overhea...

متن کامل

Resource-aware control for cyber-physical systems

An efficient usage of available resources is a substantial requirement for the successful control design in cyber-physical systems. Recent results indicate major benefits of event-based control compared to conventional designs, when resources such as communication, energy, and/or computation, are scarce. In this work we consider multiple control loops which share the communication resource. We ...

متن کامل

Reinforcement Learning Based PID Control of Wind Energy Conversion Systems

In this paper an adaptive PID controller for Wind Energy Conversion Systems (WECS) has been developed. Theadaptation technique applied to this controller is based on Reinforcement Learning (RL) theory. Nonlinearcharacteristics of wind variations as plant input, wind turbine structure and generator operational behaviordemand for high quality adaptive controller to ensure both robust stability an...

متن کامل

Vision-based Deep Reinforcement Learning

Recently, Google Deepmind showcased how Deep learning can be used in conjunction with existing Reinforcement Learning (RL) techniques to play Atari games[11], beat a world-class player [14] in the game of Go and solve complicated riddles [3]. Deep learning has been shown to be successful in extracting useful, nonlinear features from high-dimensional media such as images, text, video and audio [...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE transactions on emerging topics in computational intelligence

سال: 2022

ISSN: ['2471-285X']

DOI: https://doi.org/10.1109/tetci.2020.3044082